Measuring and verifying drug portions

ABSTRACT

Methods for measuring and verifying drug portions while avoiding the need to teach verification devices is provided. Characteristic key data of a drug type are compiled with a calibrated camera of a measuring device, stored in a storage device, and retrieved from or transmitted to a verification device. Individual key data for a drug portion to be verified are compiled using a calibrated camera of the verification device and compared with the characteristic key data. A digital image of a drug portion to be verified is generated with a calibrated camera and transferred to a control unit. The control unit determines individual key data for the drug portion to be verified using known calibration parameters of the camera and the digital image, compares the individual key data with characteristic key data of the corresponding drug type and verifies or rejects the drug portion based on the results of the comparison. Systems and computer readable medium are also provided.

CROSS-REFERENCE TO RELATED APPLICATION

This application is a continuation application of U.S. patentapplication Ser. No. 16/516,535, entitled “MEASURING AND VERIFYING DRUGPORTIONS,” filed Jul. 19, 2019, the disclosure of which is herebyincorporated by reference in its entirety.

BACKGROUND

The present disclosure relates to a method for measuring and verifyingdrug portions, a corresponding system comprising a measuring device, astorage device, and a verification device, and computer programproducts.

SUMMARY

One or more embodiments provide a method for measuring and verifyingdrug portions, comprising: receiving a first digital image of anunpackaged drug portion of a drug type with a calibrated measuringcamera disposed over a support surface upon which the unpackaged drugportion is arranged; compiling characteristic key data for the drug typeby a measuring camera controller using at least: (i) a first calibrationparameter of the calibrated measuring camera and (ii) the digital imageof the unpackaged drug portion; transmitting at least a portion of thecharacteristic key data to a verification device controller disposedseparately from the calibrated measuring camera; receiving a seconddigital image of a package including a drug portion to be verified witha calibrated verification camera arranged above the package and separatefrom the calibrated measuring camera; determining individual key datafor the drug portion included in the package by the verification devicecontroller based at least on: (i) a second calibration parameter of thecalibrated verification camera and (ii) the second digital image of thepackage including the drug portion; comparing, by the verificationdevice controller, the individual key data with characteristic key dataof the drug type; and verifying or rejecting the package including thedrug portion as being of the drug type based on a result of thecomparing.

One or more embodiments provide a system for measuring and verifyingdrug portions, comprising: a measuring device in communication with afirst calibrated camera disposed above a support surface, the measuringdevice configured to: receive, from the first calibrated camera, a firstdigital image of an unpackaged drug portion of a drug type on thesupport surface, and compile characteristic key data for the drug typeusing at least: (i) a first calibration parameter of the firstcalibrated camera and (ii) the first digital image of the unpackageddrug portion; and a verification device having a storage device and incommunication with a second calibrated camera, wherein the verificationdevice is separate from the measuring device, and wherein the secondcalibrated camera is separate from the first calibrated camera, andwherein the verification device is configured to: receive at least aportion of the characteristic key data from the measuring device, storethe at least a portion of the characteristic key data in the storagedevice, receive, from the second calibrated camera, a second digitalimage of a packaged drug portion to be verified, generate individual keydata for the packaged drug portion based at least on: (i) a secondcalibration parameter of the second calibrated camera and (ii) thesecond digital image of the packaged drug portion, and generate averification output indicating whether the packaged drug portion is thedrug type based at least in part on a comparison between thecharacteristic key data for the drug type and the individual key data.

One or more embodiments provide a non-transitory computer-readablemedium comprising instructions stored therein, which when executed byone or more processors, cause the processors to: generate a firstdigital image of an unpackaged drug portion of a drug type with acalibrated measuring camera disposed perpendicular to a support surfaceupon which the unpackaged drug portion is arranged; compilecharacteristic key data for the drug type using at least: (i) a firstcalibration parameter of the calibrated measuring camera and (ii) thefirst digital image of the unpackaged drug portion retrieve at least aportion of the characteristic key data from or transmit at least aportion of the characteristic key data to a verification device disposedseparately from the measuring camera; and generate a second digitalimage of a packaged drug portion to be verified with a calibratedverification camera arranged perpendicular to the packaged drug portionand separate from the calibrated measuring camera.

The foregoing and other features, aspects and advantages of thedisclosed embodiments will become more apparent from the followingdetailed description and accompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

The device according to the present disclosure and the method accordingto the present disclosure are described in greater detail below, withreference to the appended drawings.

FIG. 1 is a flow chart of a method for measuring and verifying drugportions.

FIG. 2 is a schematic representation of a compilation of characteristickey data and a comparison with individual key data.

FIG. 3 is a schematic representation of a system for measuring andverifying drug portions.

FIG. 4 is a top view of a blister tube with multiple blister bags.

FIG. 5 is a schematic representation of a comparison and verification ofindividual key data and characteristic key data.

FIG. 6 is a schematic representation of a calibration process.

FIG. 7 is a schematic representation of a generation of a calibrationparameter.

DETAILED DESCRIPTION

The detailed description set forth below describes variousconfigurations of the subject technology and is not intended torepresent the only configurations in which the subject technology may bepracticed. The detailed description includes specific details for thepurpose of providing a thorough understanding of the subject technology.Accordingly, dimensions are provided in regard to certain aspects asnon-limiting examples. However, it will be apparent to those skilled inthe art that the subject technology may be practiced without thesespecific details. In some instances, well-known structures andcomponents are shown in block diagram form in order to avoid obscuringthe concepts of the subject technology.

It is to be understood that the present disclosure includes examples ofthe subject technology and does not limit the scope of the appendedclaims. Various aspects of the subject technology will now be disclosedaccording to particular but non-limiting examples. Various embodimentsdescribed in the present disclosure may be carried out in different waysand variations, and in accordance with a desired application orimplementation.

Depending on the expansion stage, modern blister machines, as disclosed,for example, in WO 2013/034504 A1, which is incorporated by reference inits entirety, comprise several hundred supply and dispensing stationsfor drugs. A multiplicity of drug portions of a particular drug arestored in the supply and dispensing stations, respectively, and singleor multiple drug portions can be dispensed upon request. With theblister machine, the drugs stored in the supply and dispensing stationsare compiled and blistered patient-specifically according to themedically prescribed administration times.

For the compilation of the drug portions, corresponding supply anddispensing stations are actuated for dispensing one or more individualdrug portions. When actuating a supply and dispensing station, a singledrug portion is separated with a singulator and transferred via adispensing opening of a guide device of the blister machine. By means ofthe guide device, a dispensed drug portion, optionally with theinterposition of a collecting device, is fed to a packaging device whichpackages or blisters individual or multiple drug portions according tothe medical requirements.

During the blistering by means of the packaging device, one or more drugportions is/are packaged in a blister bag which comprisespatient-specific information as well as information about the drugportion(s) in the blister bag. For example, this information can beprinted on a specific section of the blister bag. The blister bag itselfis usually part of a blister tube which is guided out of the blistermachine and stored for further processing. The further processing of theindividual blister bags or of the blister tube regularly comprises averification of the blister bags with regard to the drug portion or drugportions arranged in them in order to ensure that the drug portion(s),and only the drug portion or portions, which is/are supposed to bearranged in said blister bag, is/are arranged in a specific blister bag.In modern blister machines, the error rate with regard to the dispensingof a drug portion of a wrong drug type is very low. However, since theadministration of a wrong drug type for a patient can have seriousconsequences, a follow-up inspection is an essential part of the blisterbag production.

In order to detect incorrectly fitted blister bags, a blister tube canbe guided through a control unit, with which a user verifies theaccuracy of the filling of a blister bag, for example, in that an imageof the blister bag to be verified is displayed on a screen and, usingthe display and a target composition also displayed on a screen, theuser verifies whether the filling corresponds to the specification(i.e., the quantity of the present drug portions, whose appearance andpossibly whose shape correspond to the specification of the targetcomposition). With this process, it is also possible to detect if drugportions were broken by the singulation process and filled into theblister bag in a broken and damaged state.

The verification by a user is very time-consuming and costly. Therefore,automatic control units have been developed, with which a preliminarycheck is performed by machine, and a user is supposed to verify ablister bag only in case of inconclusive results of the mechanicalverification. With the device disclosed in the aforementioned document,the quantity of drug portions arranged in a blister bag is determined bymeans of a camera and compared with the quantity which is supposed to bearranged according to a specification in the blister bag to be verified.However, with the control unit disclosed in said document, the drugportions are verified only in terms of their quantity. Incorrect drugportions cannot be recognized as long as their quantity corresponds tothe specification.

With other known control units, parameters of the drug portions aredetermined using a camera image and an appropriate software. In order toidentify individual drug portions, the parameters (or images or imagesections) determined using the camera image are compared with storedtarget variables (or images).

A disadvantage of the aforementioned control units is that each system,prior to activation with the drug types it is supposed to verify, mustbe taught because the cameras of each inspection system are arrangedslightly differently in each system, and due to deviations in theoptics, they also produce slightly different images which deviate todifferent degrees from the appearances of the “real” drug portions(e.g., they recognize colors and shapes differently). Only by means ofthe teaching can it be ensured that, despite the abovementioneddeviations, the control unit can correctly verify or recognize the drugportions.

It is the object of the present disclosure to provide a method and asystem, with which a teaching of a device for verifying drug portionscan be avoided.

According to one or more embodiments, this object is achieved by amethod for measuring and verifying drug portions. The method mayinclude, in a step a), characteristic key data of a drug type areinitially compiled with a calibrated camera of a measuring device.Characteristic key data of a drug type are, for example, the size orshape of a drug portion, the color of the drug portion or its reflectionpattern. Furthermore, it is possible to record as characteristic keydata also the 3D profile of a drug portion of a drug type, whichrequires special cameras. Furthermore, the drug portion can be examinedfor damage, for example, using the 3D profile.

The characteristic key data are compiled by using the calibrated camerato generate at least one digital image of the drug portion and totransfer the generated digital image to a control unit. The control unitthen uses the digital image to compile the characteristic key data forthe drugs by means of an image processing program known from the priorart and taking into account the known calibration parameters of thecamera.

As mentioned above, due to slight deviations in the camera optics, amongothers, and deviations with regard to the arrangement of the camerarelative to the object to be imaged, each camera generates differentdigital images of the same object, and so image processing programswould compile deviating characteristic key data on the basis of thedifferent digital images. It is therefore desired that a calibratedcamera is used for generating the digital image of the drug portions,and so “normalized” characteristic key data are compiled with themeasuring device. It is irrelevant which camera or which method is usedto normalize the camera, as long as the characteristic key data reflectthe true key data of the drug type (e.g., its correct size and color,and the like). Since certain deviations in shape, size and color occurduring the production of the drug portions, it is customary to record aplurality of images, from which a plurality of key data are determinedand from which a key data range is subsequently determined. However,within the scope of the application, this shall not be further mentionedexplicitly, i.e., key data generally shall refer to key data ranges.

In a step b), the characteristic key data of the drug type are stored bythe measuring device in a storage device. At least the aforementionedstep a) is then repeated until the characteristic key data of alldesired drug types have been obtained. It will be necessary to regularlydetermine new key data according to the above specification for newproducts or changes to the drug portions. These are then stored orupdated in the storage device.

In order to be able to use the characteristic key data compiled by themeasuring device for a verification, for example, of blistered drugportions, it is provided in a step c) that the characteristic key dataare retrieved from or transmitted to a verification device.

The transmission to and from the storage device can be executed with anyof the data transfer methods known from the prior art. For example, thestorage device can possibly temporarily be connected to the control unitof the measuring device or verification device via a wireless orcable-based communication network. Alternatively, mobile data carriers,such as USB sticks or hard drives, can also be used for the“transferring.”

In a step d), a calibrated camera of the verification device is used tocompile individual key data for a drug portion to be verified andcompare them with characteristic key data of the drug type, the presenceof which is to be verified. In the following, reference shall be made to“one” drug portion. However, it is evident that a compilation of severaldrug portions can also be verified, and so in the following, the plural“drug portions” shall also be included.

The measuring device must be provided with information as to which drugportion(s) of which drug type(s) is/are to be verified. For example,this can be accomplished by acquiring data applied to a blister bag bymeans of a data detection unit, wherein the data contain informationabout the drug types included (e.g., indicate the target composition).As another example, the verification device can be provided with thedata which were also provided to the blister machine for compiling thedrug portions, and so the measuring device knows at all times which drugportion(s) of which drug type(s) is/are to be verified.

In order to be able to make a comparison between individual key data andcharacteristic key data, a calibrated camera of the verification devicegenerates at least one digital image of a drug portion to be verified,transfers the generated digital image of the drug portion to be verifiedto a control unit, and the control unit determines individual key datafor the drug portion to be verified using known calibration parametersof the camera, the verification device, and the digital image. If acompilation of multiple drug portions is to be verified, the individualkey data can be generated on the basis of the camera and software used,using an image of all drug portions or multiple images (e.g., of onedrug portion each). The individual key data are subsequently compared bya control unit with characteristic key data of the corresponding drugtype(s), and based on the comparison results, the drug portion isverified or rejected. A drug portion is verified, when thecharacteristic key data coincide with the individual key data, whiletaking into account predetermined error margins.

Due to the use of a calibrated camera in both the measuring device andthe verification device and the provision of the compiled characteristickey data to a storage device accessible to both the measuring device andthe verification device, it is possible to provide a multiplicity ofverification devices with the characteristic key data generated by acentral measuring device without the need for the verification devicesto be initially taught for all drug types that they are supposed toverify. The time-consuming, expensive and error-prone process of“teaching” a verification device is eliminated by accessing alreadyexisting characteristic key data, which requires that both thecompilation of the characteristic key data of the drug types and thecompilation of the individual key data of the drug portions areperformed with calibrated cameras.

The aforementioned storage device can be part of a company-internalnetwork, for example, and so the characteristic key data can betransmitted to all verification devices connected to the companynetwork. In one or more embodiments, it is provided that thecharacteristic key data are stored via a network in a storage device,wherein the storage device is designed as a cloud storage on theInternet. By selecting a cloud storage as a storage location forcharacteristic key data, they can be made accessible at any time andworldwide to all users of verification devices, as long as theverification devices comprise appropriately calibrated cameras forcapturing a digital image of the drug portion to be verified.

In order to ensure that the characteristic key data are only transmittedto or downloaded by those verification devices that are designed to becompatible (e.g., have a calibrated camera), it is provided in one ormore embodiments that the verification device transmits anauthentication code to the storage device, that the storage deviceverifies the authentication code, and that the characteristic key datacan only be retrieved by or transmitted to the verification device ifthe authentication code is valid.

Due to changing manufacturing processes, the change, for example, of theshape of the drug portions of a drug type is a regular occurrence. Inorder to be certain at all times about the time that characteristic keydata for a drug type were compiled, it is provided in one or moreembodiments that during the compilation of the characteristic key data,they are provided with a time stamp that reflects the date of thecompilation of the characteristic key data. If the characteristic keydata comprise a time stamp, the verification device checks the timestamp of the characteristic key data associated with the individual keydata prior to the comparison of the characteristic key data with theindividual key data of the drug portion to be verified, and retrievesfrom the storage device and internally updates the characteristic keydata, when a predetermined time difference is exceeded. In this manner,it can be avoided that characteristic key data that are too old are usedfor the comparison.

As already indicated above, it is possible that instead of a single drugportion, a compilation of drug portions, which can optionally comprisedrug portions of different drug types, is to be verified. For example,it is conceivable that three or more drug portions of different drugtypes are present in a blister bag, the contents of which is to beverified. Here, a verification takes place in that individual key dataof drug portions arranged, for example, in a blister bag are compiled bymeans of an image processing program and the calibration parameters andcompared with the characteristic key data of the drug types that aresupposed to be present in the blister bag. Due to the property of thecharacteristic key data, which characterize only the external appearanceof a drug portion, it cannot be ruled out that drug portions ofdifferent drug types have identical characteristic key data. In order toavoid erroneous positive verifications during the verification ofmultiple drug portions of a compilation, it is provided in one or moreembodiments that, during the verification of a compilation of multipledrug portions, the control unit of the verification device verifies thecharacteristic key data associated with the drug portions to be verifiedas to whether all drug portions of the compilation are clearlyverifiable (e.g., it is verified whether possibly identicalcharacteristic key data are present), in which case a clearverifiability is not given.

As already stated, it is important that the cameras of the measuringdevice and the verification device are calibrated, preferably by meansof the same calibration method. For a calibration, both so-called“internal” camera parameters, which relate to the lens properties of thecamera and the relative arrangement of lens and image sensor, forexample, CCD or CMOS sensor, as well as so-called “external” cameraparameters, which relate to the geometric location, position, andorientation of the camera in space, and the lighting, must bedetermined. The calibration parameters result from the aforementionedparameters. For the calibration of a camera, any of a multiplicity ofdifferent calibration methods may be used.

In one or more embodiments, the calibration parameters KP(MESS),KP(VERI) of the cameras of the measuring and verification device aregenerated by creating digital images of a multiplicity of calibrationobjects with the cameras and comparing said images with key data for thecalibration objects for generating the calibration parameters KP(MESS),KP(VERI).

In one or more embodiments, a system for measuring and verifying drugportions is provided. The system includes a measuring device, comprisingmeans for compiling characteristic key data of a drug type by performingthe step a) according to the aforementioned method, a storage device,comprising means for storing the characteristic key data by performingthe step b) of the aforementioned method, and a verification device,comprising means for compiling individual key data for a drug portion tobe verified and for comparing the individual key data withcharacteristic key data by performing steps c) and d) in accordance withthe method according to the disclosure.

One or more embodiments provide a computer program product, comprisingcommands which prompt the measuring device of the system to compile andstore in a storage device characteristic key data for a drug type byperforming steps a) and b) in accordance with the methods describedherein.

One or more embodiments provide a computer program product, comprisingcommands which prompt the verification device of the system to compileindividual key data for drug portions to be verified and to compare themwith characteristic key data by performing steps c) and d) in accordancewith the method according to the disclosure.

FIG. 1 shows a flow chart of a method for measuring and verifying drugportions. In a first step 100, a digital image of a drug portion of adrug type is compiled with a calibrated camera of a measuring device. Asalready mentioned above, in practice it is regularly the case that amultiplicity of images is produced, which are subjected to the followingmethod steps, and so key data ranges are compiled instead of selectivecharacteristic key data. In the following, this shall be assumed but notexplicitly described further. In a step 110, the digital image istransmitted to a control unit of the measuring device. The control unitcan be an integral component of the aforementioned camera, but it canalso be designed as a conventional computer, for example, which can becontrolled by a user via a screen. The transmission can be wireless orwire-based according to transmission methods known to a person skilledin the art. In a step 120, characteristic key data of the drug portionof a drug type are compiled using the digital image and taking intoaccount known calibration parameters of the camera of the measuringdevice, wherein said key data can comprise, for example, size, shape,color of the drug portion. In accordance with the aforementioned methodsteps 100-120, characteristic key data are compiled for all drug typeswhich are to be verified later.

In a step 200, the characteristic key data are stored in a storagedevice, which can take place at any time (e.g., the characteristic keydata can be stored immediately after compilation or only after all drugtypes to be verified later have been processed). The type of storagedevice is not essential to the present disclosure. The transmission ofthe characteristic key data can be wire-based or wireless, but it isalso conceivable to transfer the characteristic data to a mobile datacarrier, such as a USB stick or a hard drive. In one or moreembodiments, the storage device is designed as a cloud storage, whichcan be reached at any time worldwide, and so the characteristic key dataare always and anywhere available to a third party.

In a step 300, the characteristic key data are retrieved from ortransmitted to a verification device. This retrieval or transmission canalso be wireless or wire-based. Again, it is conceivable that thestorage device for a data transfer is temporarily connected to theverification device.

The following method steps are described with reference to a single drugportion, but also apply correspondingly to a compilation of multipledrug portions. In a step 400, a digital image is generated of a drugportion of a drug type to be verified with a calibrated camera of averification device. In a step 410, the digital image is transmitted toa control unit of the verification device, wherein the description withregard to step 110 applies correspondingly. In a step 420, individualkey data of the drug portion to be verified are compiled using anappropriately designed image processing software and the knowncalibration parameters of the camera of the verification device. In astep 430, the previously compiled individual key data of the drugportion to be verified are compared with the characteristic key data ofthe drug type that the verification device “expects,” for example, in ablister bag (e.g., the drug type that was supposed to have beenblistered by the blister machine according to the specification).

If the deviations between the individual key data and the characteristickey data do not exceed specific predetermined threshold values, the drugportion is positively verified (e.g., it is confirmed that the drugportion is a drug portion of the drug type that was expected by theverification device).

FIG. 2 shows schematically, how characteristic key data for a drug typeare compiled, transmitted to a storage device, and compared withindividual key data. The digital images DAB1-DABx are analyzed using animage processing software, and the characteristic key data CKD1-CKDx arecompiled on the basis of the calibration parameters KP(MESS) of thecamera of a measuring device 10. As already indicated above, thecharacteristic key data CKD1-CKDx are consistently a multiplicity ofvalue ranges which reflect manufacturing tolerances in the production ofthe drug portions of the various drug types. The characteristic key dataCKD1-CKDx are transmitted to a storage device 20, and transmitted fromthere to a verification device 30.

The verification device uses a calibrated camera to compile digitalimages DAB1* and DAB2* of drug portions to be verified. Using imageprocessing software and methods, individual key data IKD1* and IKD2* arecompiled for the drug portions to be verified, while taking into accountthe calibration parameters KP(VERI) of the camera of the verificationdevice 30. These individual key data IKD1* and IKD2* are compared withthe characteristic key data CKD1 and CKD2 of the drug types expected bythe control unit of the verification device 30. The verification device30 is notified in advance, which drug types or drug portions of the drugtypes are expected, for example, in that this information is read from ablister bag to be examined. Based on the comparison of the individualkey data IKD1* and IKD2* with the characteristic key data CKD1 and CKD2,it is subsequently decided whether the drug portions correspond to thedrug portions that were expected, while taking into account specificspecifications.

FIG. 3 shows a schematic representation of a system for measuring andverifying drug portions. The upper section shows two views of themeasuring device 10; a side view is shown in the upper section, and atop view is shown in the lower section, wherein only the “left” sectionswith the camera vary. The measuring device includes a camera 1, which iscoupled via a line 6 to a control unit 2, which in turn is coupled via aline 7 to a display unit 3. Below the camera 1, a drug portion 50 of adrug type to be measured is arranged on a support table 4. The camera 1has a predetermined distance H1 from the surface of the support table,wherein the distance H1 corresponds exactly to the distance that thecamera 1 had to the support table 4 during the calibration of the camera1 (e.g., a so-called external calibration parameter). In one or moreembodiments, the control unit 2 is connected via a communication link 8to a storage device 20, which in the embodiment shown is designed as acloud storage which is part of the schematically indicated internet 21.Any wire-based and wireless transmission method(s) necessary for thetransmission via the internet may be used.

The storage device 20 is connected via a communication link 25 to acontrol unit 32 of the verification device 30. The communication link 25may be temporary, for example. The control unit 32 is connected via aline 37 to a display unit 33 and via a line 36 to a camera 31. Inaddition, the control unit 32 is coupled to a detection unit 35. In theembodiment shown, the camera 31 is arranged above a blister tube 40consisting of multiple blister bags 41. The blister tube 40 is rolledaround a roll 38 and is moved over a surface 34 and onto the roll 39 forverifying the drug portions in the individual blister bags 41. For thispurpose, the roller 39 is driven by a motor (not depicted). With thecamera 31, a digital image of the drug portion(s) in a blister bag 41 isgenerated and transmitted via the line 36 to the control unit 32. Bymeans of the detection unit 35, data printed on the blister bags 41 areread out, the data indicating, among others, which drug portion(s)is/are supposed to be arranged in the individual blister bags 41.

The connection between any of the above described components may bewired or wireless. For example, any of lines 6, 7, 36, 37 or links 8, 25may include wiring (e.g., Ethernet, RS232, twisted pair) or wirelessconnections (e.g., RF, Bluetooth).

FIG. 4 shows a schematic representation of a blister tube 40 with fourblister bags 41 a-41 d and drug portions 51, 52 arranged in same. In theupper section, each blister bag 41 a-41 d includes a data section 42a-42 d, in which information (not depicted) about the drug portions ortypes, which are supposed to be arranged in the blister bag 41 a-41 d,is printed.

FIG. 5 illustrates schematically the verification of drug portions. Inthe upper row, individual key data IKD1-IKD4 relating to the shape ofthe drug portions are reproduced by visually depicting the shape of thedrug portions located in the blister bags 41 a-41 d. The line belowshows characteristic key data CKD1-CKD4 about the shape of those drugportions or types which are expected by the verification device in theblister bags 41 a-41 d. The bottom line according to FIG. 5 illustratesthe result of the verification. The individual key data IKD1 and IKD2are verified positively, and the individual key data IKD3 and IKD4 areverified negatively.

FIG. 6 roughly schematically illustrates, how the camera 1 of themeasuring device is calibrated, wherein the same also applies to thecamera 31 of a verification device. During calibration, a multiplicityof calibration objects, of which only one calibration object KO1 isshown, are placed under the camera 1, 31, and a digital image of thecalibration objects is generated. Characteristic parameters for themeasured calibration object KO1 are compiled by an image processingsoftware, and using these characteristic parameters, it can bedetermined whether and to what extent the image produced by the camera1, 31 deviates from the actual appearance of the calibration object KO1.

In FIG. 7, this is shown schematically for the characteristic parameter“size,” wherein this representation is very simplified and supposed tomerely show the principle. In the middle of FIG. 7, the results of theimage processing for calibration object KO1 with respect to theparameter “size” are optically reproduced. Using the size differences,it is apparent that the size of the object according to the digitalobject does not correspond to the “true” size of the calibration objectKO1. In the illustrated case, the size of the object DAB(KO1) accordingto the digital image is only 75%, though such a deviation does nottypically occur in reality. Due to the described deviation, camera 1 hasa calibration factor KP1 of 1.25 with respect to the characteristicparameter “size,” i.e., the parameters determined with the imageprocessing software must be converted with this calibration parameter inorder to obtain the “true” characteristic parameter “size.”

The present disclosure is provided to enable any person skilled in theart to practice the various aspects described herein. The disclosureprovides various examples of the subject technology, and the subjecttechnology is not limited to these examples. Various modifications tothese aspects will be readily apparent to those skilled in the art, andthe generic principles defined herein may be applied to other aspects.

A reference to an element in the singular is not intended to mean “oneand only one” unless specifically so stated, but rather “one or more.”Unless specifically stated otherwise, the term “some” refers to one ormore. Pronouns in the masculine (e.g., his) include the feminine andneuter gender (e.g., her and its) and vice versa. Headings andsubheadings, if any, are used for convenience only and do not limit thesubject technology.

The word “exemplary” or the term “for example” is used herein to mean“serving as an example or illustration.” Any aspect or design describedherein as “exemplary” or “for example” is not necessarily to beconstrued as preferred or advantageous over other aspects or designs. Inone aspect, various alternative configurations and operations describedherein may be considered to be at least equivalent.

As used herein, the phrase “at least one of” preceding a series ofitems, with the term “or” to separate any of the items, modifies thelist as a whole, rather than each item of the list. The phrase “at leastone of” does not require selection of at least one item; rather, thephrase allows a meaning that includes at least one of any one of theitems, and/or at least one of any combination of the items, and/or atleast one of each of the items. By way of example, the phrase “at leastone of A, B, or C” may refer to: only A, only B, or only C; or anycombination of A, B, and C.

A phrase such as an “aspect” does not imply that such aspect isessential to the subject technology or that such aspect applies to allconfigurations of the subject technology. A disclosure relating to anaspect may apply to all configurations, or one or more configurations.An aspect may provide one or more examples. A phrase such as an aspectmay refer to one or more aspects and vice versa. A phrase such as an“embodiment” does not imply that such embodiment is essential to thesubject technology or that such embodiment applies to all configurationsof the subject technology. A disclosure relating to an embodiment mayapply to all embodiments, or one or more embodiments. An embodiment mayprovide one or more examples. A phrase such an embodiment may refer toone or more embodiments and vice versa. A phrase such as a“configuration” does not imply that such configuration is essential tothe subject technology or that such configuration applies to allconfigurations of the subject technology. A disclosure relating to aconfiguration may apply to all configurations, or one or moreconfigurations. A configuration may provide one or more examples. Aphrase such a configuration may refer to one or more configurations andvice versa.

In one aspect, unless otherwise stated, all measurements, values,ratings, positions, magnitudes, sizes, and other specifications that areset forth in this specification, including in the claims that follow,are approximate, not exact. In one aspect, they are intended to have areasonable range that is consistent with the functions to which theyrelate and with what is customary in the art to which they pertain.

It is understood that the specific order or hierarchy of steps,operations or processes disclosed is an illustration of exemplaryapproaches. Based upon design preferences, it is understood that thespecific order or hierarchy of steps, operations or processes may berearranged. Some of the steps, operations or processes may be performedsimultaneously. Some or all of the steps, operations, or processes maybe performed automatically, without the intervention of a user. Theaccompanying method claims, if any, present elements of the varioussteps, operations or processes in a sample order, and are not meant tobe limited to the specific order or hierarchy presented.

All structural and functional equivalents to the elements of the variousaspects described throughout this disclosure that are known or latercome to be known to those of ordinary skill in the art are expresslyincorporated herein by reference and are intended to be encompassed bythe claims. Moreover, nothing disclosed herein is intended to bededicated to the public regardless of whether such disclosure isexplicitly recited in the claims. No claim element is to be construedunder the provisions of 35 U.S.C. § 112 (f) unless the element isexpressly recited using the phrase “means for” or, in the case of amethod claim, the element is recited using the phrase “step for.”Furthermore, to the extent that the term “include,” “have,” or the likeis used, such term is intended to be inclusive in a manner similar tothe term “comprise” as “comprise” is interpreted when employed as atransitional word in a claim.

The Title, Background, Summary, Brief Description of the Drawings andAbstract of the disclosure are hereby incorporated into the disclosureand are provided as illustrative examples of the disclosure, not asrestrictive descriptions. It is submitted with the understanding thatthey will not be used to limit the scope or meaning of the claims. Inaddition, in the Detailed Description, it can be seen that thedescription provides illustrative examples and the various features aregrouped together in various embodiments for the purpose of streamliningthe disclosure. This method of disclosure is not to be interpreted asreflecting an intention that the claimed subject matter requires morefeatures than are expressly recited in each claim. Rather, as thefollowing claims reflect, inventive subject matter lies in less than allfeatures of a single disclosed configuration or operation. The followingclaims are hereby incorporated into the Detailed Description, with eachclaim standing on its own as a separately claimed subject matter.

The claims are not intended to be limited to the aspects describedherein, but are to be accorded the full scope consistent with thelanguage claims and to encompass all legal equivalents. Notwithstanding,none of the claims are intended to embrace subject matter that fails tosatisfy the requirement of 35 U.S.C. § 101, 102, or 103, nor should theybe interpreted in such a way.

1. A method for measuring and verifying drug portions, comprising:receiving a first digital image of an unpackaged drug portion of a drugtype with a calibrated measuring camera disposed over a support surfaceupon which the unpackaged drug portion is arranged; compilingcharacteristic key data for the drug type by a measuring cameracontroller using at least: (i) a first calibration parameter of thecalibrated measuring camera and (ii) the digital image of the unpackageddrug portion; transmitting at least a portion of the characteristic keydata to a verification device controller disposed separately from thecalibrated measuring camera; receiving a second digital image of apackage including a drug portion to be verified with a calibratedverification camera arranged above the package and separate from thecalibrated measuring camera; determining individual key data for thedrug portion included in the package by the verification devicecontroller based at least on: (i) a second calibration parameter of thecalibrated verification camera and (ii) the second digital image of thepackage including the drug portion; comparing, by the verificationdevice controller, the individual key data with characteristic key dataof the drug type; and verifying or rejecting the package including thedrug portion as being of the drug type based on a result of thecomparing.
 2. The method of claim 1, further comprising: storing thecharacteristic key data via a communication link in a storage deviceattached to a wide area network.
 3. The method of claim 1, furthercomprising: transmitting, by the verification device controller, anauthentication code; verifying, by a storage device, the authenticationcode; and retrieving, by the verification device controller, thecharacteristic key data from the storage device only if theauthentication code is valid.
 4. The method of claim 1, furthercomprising: transmitting, by the verification device controller, anauthentication code; verifying, by a storage device, the authenticationcode; and transmitting the characteristic key data from to theverification device controller only if the authentication code is valid.5. The method of claim 1, further comprising, during compilation of thecharacteristic key data, receiving a time stamp.
 6. The method of claim5, further comprising, prior to comparing the characteristic key datawith the individual key data of the drug portion to be verified:verifying, by the verification device controller, the time stamp of thecharacteristic key data associated with the individual key data; andretrieving and updating the characteristic key data when a predeterminedtime difference is exceeded.
 7. The method of claim 1, wherein thepackage includes multiple drug portions, and wherein said verifying orrejecting comprises: verifying or rejecting the package, by theverification device controller, based at least in part on thecharacteristic key data associated with respective drug types for eachof the multiple drug portions and on the individual key data generatedusing the second image of the package.
 8. The method of claim 1, furthercomprising: obtaining, by an imaging device, a multiplicity of digitalimages of a calibration object having calibration characteristic data;and generating, by a controller of the imaging device, a calibrationparameter for the imaging device based at least in part on key data forthe calibration object and calibration data generated from themultiplicity of digital images, wherein the imaging device is one of thecalibrated measuring camera or the calibrated verification camera, andwherein the controller is one of the measuring camera controller or theverification camera controller.
 9. The method of claim 1, furthercomprising: positively verifying the drug portion as being of the drugtype if deviations between the individual key data and thecharacteristic key data do not exceed specific predetermined thresholdvalues.
 10. The method of claim 1, further comprising: positioning thecalibrated measuring camera during use at the same distance from asupport table as the measuring camera was positioned during calibration.11. The method of claim 1, wherein drug portions to be measured andverified are disposed in one or more blister bags, wherein a pluralityof blister bags are joined together in a blister tube, and the methodfurther comprising: moving the blister tube from a first roll to asecond roll past the calibrated measuring camera.
 12. The method ofclaim 11, further comprising: reproducing individual key data relatingto the shape of the drug portions by visually depicting the shape of thedrug portions located in the one or more blister bags.
 13. A system formeasuring and verifying drug portions, comprising: a measuring device incommunication with a first calibrated camera disposed above a supportsurface, the measuring device configured to: receive, from the firstcalibrated camera, a first digital image of an unpackaged drug portionof a drug type on the support surface, and compile characteristic keydata for the drug type using at least: (i) a first calibration parameterof the first calibrated camera and (ii) the first digital image of theunpackaged drug portion; and a verification device having a storagedevice and in communication with a second calibrated camera, wherein theverification device is separate from the measuring device, and whereinthe second calibrated camera is separate from the first calibratedcamera, and wherein the verification device is configured to: receive atleast a portion of the characteristic key data from the measuringdevice, store the at least a portion of the characteristic key data inthe storage device, receive, from the second calibrated camera, a seconddigital image of a packaged drug portion to be verified, generateindividual key data for the packaged drug portion based at least on: (i)a second calibration parameter of the second calibrated camera and (ii)the second digital image of the packaged drug portion, and generate averification output indicating whether the packaged drug portion is thedrug type based at least in part on a comparison between thecharacteristic key data for the drug type and the individual key data.14. The system of claim 13, wherein the packaged drug portion isenclosed within a blister bag included in a blister tube of joinedblister bags, wherein the blister tube is arranged to pass within afield of view of the second calibrated camera, wherein the systemincludes a first roll and a second roll, and wherein the system at leastone of the first roll and the second roll rotate in response to theverification output.
 15. The system of claim 13, wherein theverification device is configured to transmit an authentication code toretrieve the characteristic key data for the drug type; and wherein thestorage device is configured to: determine that the authentication codeis valid, and after determining that the authentication code is valid,provide, to the verification device, the characteristic key data. 16.The system of claim 13, further comprising the first calibrated cameraand the second calibrated camera, and wherein the first calibratedcamera is arranged at a first height above the support surface thatcorresponds to a second height of the second calibrated camera above asurface supporting the packaged drug portion.
 17. A non-transitorycomputer-readable medium comprising instructions stored therein, whichwhen executed by one or more processors, cause the processors to:generate a first digital image of an unpackaged drug portion of a drugtype with a calibrated measuring camera disposed perpendicular to asupport surface upon which the unpackaged drug portion is arranged;compile characteristic key data for the drug type using at least: (i) afirst calibration parameter of the calibrated measuring camera and (ii)the first digital image of the unpackaged drug portion retrieve at leasta portion of the characteristic key data from or transmit at least aportion of the characteristic key data to a verification device disposedseparately from the measuring camera; and generate a second digitalimage of a packaged drug portion to be verified with a calibratedverification camera arranged perpendicular to the packaged drug portionand separate from the calibrated measuring camera.
 18. Thenon-transitory computer-readable medium of claim 17, further comprisinginstructions stored therein, which when executed by the one or moreprocessors, cause the processors to: generate individual key data forthe packaged drug portion based at least on: (i) a second calibrationparameter of a calibrated verification camera and (ii) the seconddigital image of the packaged drug portion, and generate a verificationoutput indicating whether the packaged drug portion is the drug typebased at least in part on a comparison between the characteristic keydata for the drug type and the individual key data.
 19. Thenon-transitory computer-readable medium of claim 17, further comprisinginstructions stored therein, which when executed by the one or moreprocessors, cause the processors to: receive at or transmit to averification controller, an expected drug type for the packaged drugportion, and wherein the characteristic key data retrieved ortransmitted corresponds to the expected drug type.
 20. Thenon-transitory computer-readable medium of claim 17, wherein thecharacteristic key data comprises a range for a characteristic of thedrug type, wherein the instructions stored therein, which when executedby the one or more processors, cause the processors to generate therange based on a plurality of digital images of the drug type and thecalibration parameter.